S3Drive - Two-way sync on Android: deletions

Hi, I'm trying to set up bidirectional sync on Android and it's not going well. When I start with an empty folder on both ends and add files on one end, they are synced to the other end. But when I delete a file on one end, I'm either getting the error "Error: Exception: too many deletes" or the file I deleted is added back from instead of deleted on the other end (and I was not using the "Run with --resync" button). Tried it between a local folder and: • Rclone crypt-on-WebDAV • Rclone plain WebDAV • S3Drive account space, unencrypted Tried it with the local folder as the source as well as destination (which of course doesn't make a difference with two-way sync but I had to check). Also, at some point during my testing S3Drive refused to sync because of a lock file still in place, which it assumed meant that a previous sync had been aborted before it was finished. The error message said to remove the lock file manually but there was nothing I could do, since I had no access to the location where the lock file was stored (it was something like /data/user/0/com.s3.drive.file.explorer.storage.cloud.manager/.cache/bisync) S3Drive v1.9.1 (build: 10090105) on Android 13.

Thanks for your feedback, we will be looking to allocate more development time to improve sync functionality, improve resilience, allow user to act on unrecoverable errors, try to resolve simple ones. We've left "--resync" option, as a quick way of resolving most errors, but since it also resolves some more serious errors in a way which may assume incorrect conflict resolution we've left it as a manual one. If you haven't removed your sync just yet, feel free to stop it, we will try to push some improvements in a 1.9.2 version already, in which case the state might recover itself. (edited)

Hey Tom, appreciate your reply. So is two way sync just broken for everyone right now, or is it just me?

Tried it again just now, using a little more files and folders than in my earlier tests; a copy of the folder structure I would want to sync in two directions. Everything synced fine, then I renamed a bunch of folders locally and got "Error: Exception: bisync aborted" in S3Drive.

Hi @Unlawful Cactus and sorry for the late reply. Current two-way sync as it is was probably released too soon. We've hoped that we can release it early, replace the previous Sync engine that was buggy, unsafe, with a new one powered by Rclone. The issue is that it's not as easy as we've thought as it requires some general tweaking and out of the box isn't suited for fully non-interactive run. There are multiple issues that needs to be addressed in a two-way sync (and sync functionality) for a seamless integration. Error that you've got is a generic one, whereas internal one isn't displayed, we'll need to find a way to include error logs from Rclone to our log window. ...we've seen that one appearing when E2E encryption is enabled and when sync path contains folder that was created using S3Drive having an empty file: .empty. Removing that file manually (please note that you'll need different files in a folder to prevent folder deletion) may resolve this error, however run with: --resync option might be required. We will mark this feature as experimental in a next release, add --resilient option and then will have to allocate more time to improve it. Sorry for this subpar experience, I hope we can get that reworked later this year.

Thanks for clarifying. I might play around with rclone directly some time then (in Termux), see how it fares.

Unlawful Cactus

Thanks for clarifying. I might play around with rclone directly some time then (in Termux), see how it fares.

On Rclone forum there are couple post with potentially useful flag combinations which may render two-way sync more usable e.g. --max-lock 5M --compare size,modtime,checksum --slow-hash-sync-only --resilient -MvP --drive-skip-gdocs --fix-case . --drive-skip-gdocs is specific to Gdrive only. Initially run must be executed with: --resync and not entirely sure what: -MvP stands for. EDIT: This one is blocker for S3Drive to integrate max-lock and recover option: https://github.com/rclone/rclone/issues/7799 (edited)

Options recover and max-lock missing in cmd/bisync/rc.go · Issue #7...

Hi all, I was trying to integrate rclone into my system by using it as rcd server. Noticed today there is no mappings for the options --recover and --max-lock on the api command sync/bisync Checked...